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Abstract 


In this thesis we propose an efficient algorithm for solving the Longest Tandem Subse- 
quence(Lr5) problem. The earlier algorithm (A. Kosowski, SPIRE(2004)^ 93-100) for 
finding the LTS of a sequence 5 [siS2...5ti] takes O(n^) space and time, where ‘n’ is the 
size of the sequence. Our algorithm takes 0{na + dp log d) time and 0(na -f np) space. 
Here ‘cr’ is the size of the alphabet, ^p’ is the size of the output (length of the LTS), and 
(d = 77 - — 2p 1). 

We also describe a new data structure for finding the Longest Common Subsequence 
{LCS) between two sequences D[did 2 ^>-dn] and Q[qiq2‘-Qm], ^ The data structure 
requires 0(n) time and space for construction, assuming that the size of the alphabet, a 
is “large” (a > (n/log^ n)). The time complexity of our LCS algorithm is O(mploglog?^), 
where ‘p’ is the length of the LCS. 

Finally, we describe some variations of the search data structure used in solving the LCS 
problem. These variations allow us to specify any search parameter A (where A = fi(l) 
and A = 0{logn)) with trade-offs between space and time required for constructing the 
data structure. 
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Chapter 1 


Introduction 


A character sequence S of length n over a nonempty alphabet E is a function S : 
(l,n) — > E (here (z, j) is used to denote the set of consecutive numbers {z, z + 

The symbol Sj, where 1 < z < n, is used to denote the element of the sequence S. The 
size of the alphabet is denoted by a, that is [SI = cr. 

Example S = aabccabbc^ E = {a, f), c} is a sequence of size 9 , where we have si = 
Oj^ ““ dj S3 bmm» and sq — c« I 

Definition 1.1 A sequence S of length n is called a tandem sequence if n is an even 
number and = 8 i+n/ 2 ^ 

Example S = abcaabca^ is a tandem sequence of length 4 with 5 i = S5, S2 = 5 $, S3 = S7 
and S4 = sg. I 

Definition 1,2 A sequence T, |r| = m, is called a subsequence of S | 5 | = n, if it is 
possible to define an increasing function h : (l,fc) — > (IjZz), such that yi<i<kU = 

This relation between the sequences T and 5 is written in the form T Q S. 

Example T = acba is a subsequence of the the sequence S = abcabca^ where ti = 
si,t 2 = S3, ts = S5 and ^4 = S7. | 

The Longest Tandem Subsequence (LTS) problem for a given sequence S is the prob- 
lem of finding a tandem sequence T such that T Q S and the length of the sequence T is 
the maximum possible. 
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Example The longest tandem subsequence of the sequence S = adbaccacbdc, is the 
sequence T = abcabc of length 6 -with si = 57, 53 = sg and S5 = su. | 

The Longest Common Subsequence LCS{A^ B) of two sequences A and S is a sequence 
P of the maximum possible length such that P □ A and P Q B. 

Example The longest common subsequences between the sequences A = aabcaacb and 
B = bbcbcabc are P = {bcac^ bcab}, | 

1.1 Organization of the Thesis 

The thesis is organized as follows. In Chapter 2 we discuss some preliminaries related to 
the Longest Common Subsequence problem. In Chapter 3 we talk about previous and 
some related work to the Longest Tandem Subsequence problem. We also briefly describe 
our approach in this chapter. Then, in Chapter 4 we describe our algorithm in detail. 
The correctness of the algorithm and analysis are covered in Chapter 5 . In Chapter 6 
we propose a new algorithm to the Longest Common Subsequence problem. Finally, in 
Chapter 7 we give some variations of the data structure proposed in Chapter 6. 
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Chapter 2 


Longest Common Subsequence 
(LCS) 


Given two sequences A = aia 2 --^CLm and B = bib 2 .--bm Tn < over some alphabet E 
of size a, the longest common subsequence {LCS) problem is to find a subsequence of 
greatest possible length that occurs in both A and B. 

Next, we define a few concepts related to the LCS problem, as presented in Rick’s ^ 
[14] work. These concepts were first introduced by Hirschberg[5]. 

Definition 2.1 A match is an ordered pair 1 < i < m and 1 < i < n, such that 

CLi ~ bj . 

The set of all matches between A and B can be represented in a m x n matrix, M. Two 
matches (z, j) and (i', /) may be part of a common subsequence if and only if {i < i^Aj < f) 
or {i^ <i A f < j). 

Definition 2.2 A chain is defined as a sequence of matches that is increasing in both the 
components i.e. in terms of both i and j (indicated by the dotted line in Fig. 2.1). 

The longest common subsequence. between two sequences A and B can be now seen as the 
longest chain of such matches that are strictly increasing in both the components. 

A match {i,j) is said to have a rank k if the length of the longest chain ending at (i, j) 
is k. The set of matches in M can be partitioned into classes Ci,C2...(7p, each of which 

^Verbatim from [14] 
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Figure 2.1: Contours and Dominating Matches in m x n matrix M 

contain matches of the same rank. The matches belonging to the same class can be ordered 
in the form of a contour (along increasing order of the second component j) as shown in 
Fig. 2.1. 

Lemma 2.1 Contours of different class never cross each other or touch each other. 

Proof: Let Ck and be two adjacent contours. Suppose, Ck and Ck+i did touch 

each other at some portion, then there will be some match (z,j) which belongs to both 
these contours. This implies that the length of the longest common subsequence ending 
at (z, j) is both k and (fc — 1). But this is a violation of the definition of contours, which 
says that the length of the longest common subsequence ending at a match € Ck is 
k. Hence no two contours touch each other. 

The other case we need to prove is that two contours never cross each other. If they did 
cross each other at some point, then there exists some j'O ^ Ck+u for which there is no 
match (i, j) 6 C/c, which satisfies {i < z') and {j < ff). This again violates the definition 
of contours since longer belongs to as it cannot be chained with a sequence 

of matches to obtain z. LCS of size {k + 1). | 

Definition 2.3 Dominant matches in a contour Ck are those matches {iff) € Ck for which 
there is no other match {i' ff') € Ck with {i' = iAf< j) or {i' < i Af = j) (indicated by 
the shaded circles in Fig. 2.1). 
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Lemma 2.2 Let A and B he two sequences of length m and n with the matches represented 
in m X n matrix M. Let Ci^C 2 ^^-Cp be the contours obtained from M. Then there exists 
a longest common subsequence of length p comprising of only dominant matches 

Proof: This can be proved by showing that the longest common subsequence can be 

composed by going through contours in reverse order, i.e. from Cp...C 2 ,Ci. If p = 1 
then we just have to pick one dominant match from the single contour. Now assume that 
we have constructed the longest common subsequence comprising of dominant matches 
from all the contours from Cp to C 2 . Let (i, j) be the latest dominant match (from C 2 ) 
included to this sequence. All the matches € Ci satisfy either < i A < j) or 

(i' < i A f < j) and there is at least one match which satisfies {i' <i /\ f < j). If not, Ci 
touches or crosses C 2 , which violates the definition of contours. This match {i\f) with 
{i' < i A f < j) can either be a dominant match or there exists a dominant match [i” ^j'^) 
such that A j" < j') or (z'' < A f = /). | 

Several algorithms have been suggested to find the longest common subsequence which 
make use of this contour based technique. The foremost among them is Hirschberg [4]. 
The other important work in this direction is that of Rick [14] and [13]. Bergroth and 
Hakonen [1] describe some of these contour based methods in their survey paper. 
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Chapter 3 


Longest Tandem Subsequence(ir5) 


The Longest Tandem Subsequence (LTS) for a given sequence S = siS2-‘-Sn is a tandem 
sequence T such that T C S and the length of the sequence T is the maximum possible. 
The LTS problem was first proposed by Kosowski [8]. In this chapter we briefly describe 
some previous and related works. We also provide an overview of our approach. 

3.1 Previous Work 

A related problem to Longest Tandem Subsequence is that of finding the longest repetition 
(substring) in a given input string. This problem (Longest Repetition) was first solved by 
Main and Lorentz [9], who gave an O(nlogn) time algorithm. Kolpakov and Kucherov 
[7] describe with a linear time algorithm for finding all the maximal repetitions. Another 
relating problem is concerned with Pattern discovery or Motif discovery in DNA and other 
protein sequences. One recent work in this direction is that of Chattaraj [3]. 

The Longest Tandem Subsequence problem was put forth by Kosowski [8]. The algo- 
rithm given by him works in O(n^) time using 0{n) space. In his work, LTS problem for 
a sequence S = si, 52...% is solved in two stages, which are:- 

• STAGE 1: Determine an index Z,1 < Z < n for which |I/C5([si.,.s/], [s^^-i.-.s^])! 
takes the maximum possible value. 

• STAGE 2: Compute T = LC5([si...s;], [si^-i...Sn]) and return T as output. 

The Stage 1 is achieved by using a LTSsplit algorithm. This algorithm forms the core 
of Kosowski’s [8] work. The Stage 2 is solved using Hirschberg’s [4] algorithm for longest 
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common subsequence. 


3-1.1 Algorithm: LTSsplit 

The LTSsplit^ returns the index I for which the longest tandem subsequence is obtained. 
It is based on dynamic programming and works in O(n^) time. In this section we give a 
high level idea of how this algorithm works. 


A family of functions A, for 1 < /c < n is defined. For a given k function A : Zx Z — > N 
is defined as follows: 

f lLC5([si...Si], [sj...s/c])l for 1 < i < j < /c 
fk{hj)=i 0 in all other cases when i, j > 0 

[ —1 when i,j <0 

In terms of //-, index I is expressed as /n(Z, Z + 1) = max(/n (r,r + 1), 1 < r < n). 


The values of function fkihj) for 1 < z < j < /c < n, is expressed using the following 
recursive formula: 


fkiij) 


max{/fc(i - l,j), when Si Sk 

fk-i{ij) + l when Si = Sfc 


One more function dk : N"*" x N — > {0, 1}, for (1 < < n), is expressed as: dk{i,j) = 

fk{i,j) - fk(i - 1, j) where, (1 < z < i < k). Now, fk can also be expressed as fk{i,j) = 
Er=i4(r,i) 


Lemma 3.1 The value of dk{i,j) is equal to 1 iff j € {i + l,ak{i)), for some function 
ak : N — N 


Proof: Refer Kosowski [8] for proof. | 


The set of values for Ak = {a/c(z),V(l <i< n)} is found recursively from Ak~i (this is 
a consequence of the proof of Lemma 3.1). This process takes O(n^) time. 

^This part is taken verbatim from KosowskifS] 
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The LTSsplit can now be summarized by the following two steps> 

1. For all fc, 1 < fc < n, compute the set Ak by modifying the set of values in 

2. Determine the index I from the values in An using the following equation: 

fn{i, i + l) = {p : {1 <p <i) A an{p) > i + 1} 

3.2 Our Approach 

The Longest Tandem Subsequence (LTS) for a given sequence S = 5iS2...5n is a tandem 
sequence T such that T C 5 and the length of the sequence T is the maximum possible. 
The algorithm proposed in this thesis to find the LTS for a sequence S = si,S2...5n can 
be summarized as follows: 

Step 1: Compute r „/2 = iC5(5z,[si...s„/2],.Si?[s„/2+i-Sn])- Let p = |r„/ 2 |. 

Step 2: For(l < Z < p) do 

1: Shift one symbol from Sr to Sr {bs well as from Sl to Sr). 

2; Compute Ti, the LCS between 5£,[si...S(„/2+z)] and 5ii;[s(„/2+/+i)---5n](also 

the LCS between 5L[si...S(n/2_i)] and SR[s(^ri/ 2 -i+i)-Sn]) 

3; If the current LCS, Ti, is the longest LCS obtained so far then p <= IT^I and 

nr-i m 

1 ^ T/. 

Step 3: Return T as the LTS. 

The contour based technique would serve as an efficient way to determine this index 
/, at which we get the LTS. This is because, the length of longest common subsequence 
between Sl = siS 2 ’--Si and Sr = for an index Z, (1 < Z < n) is indicated by the 

number of contours obtained from the matches between Sl and Sr. If Ci, C 2 ...Cp^ axe the 
contours obtained, then pi is the length of the longest common subsequence between Sl 
and Sr. 

The algorithm discussed in the thesis makes use of this contour based technique. Ini- 
tially, for Z = n/2, the set of contours Ci, for the two sequences Sl = siS 2 ---Sn /2 

and Sr = is found. In the subsequent iterations we shift I rightwards (also left- 

wards) one symbol at a time for (n/2 < Z < {n—pmax)) (as well as (n/2 > Z > pT„ax))times 
and re-adjust the contours at each step. Here, Pmax indicates the length of the longest 
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d a c d c a 

/ (l+l) n 


b d a c d c a 

(l+l) (1+2) n 


Figure 3.1: Contour Modification (after sliifting a from Sr to Sr) 


common subsequence obtained so far (which is nothing but the maximum number of con- 
tours obtained so far). The Fig. 3.1 shows the contour modification that takes place in 
any given iteration. 



Chapter 4 


The Algorithm 


The algorithm comprises of two parts Re-adjust Contours and Extend Contours, Re-adjust 
Contours reconstructs the contours after each shift of 1. After each shift, a symbol is added 
at the end of (or at the beginning of Sr). Therefore, a new row (column) of matches is 
included. Accordingly, the contours have to be extended to include these matches (shown 
by the dotted ellipse in Fig. 3.1(b)). The algorithm Extend Contours serves this purpose. 
The sections 4.2 and 4.3 explain these steps in greater detail. (Refer Appendix A for the 
complete pseudocode) 

4.1 Preprocessing 

A list Nexta[0..,n — 1] is constructed for each symbol a € S, which gives for any z, (0 < 
i < n), Nexta[i] = j such that sj — a with (i < j < n) and Vfc, {i < k < j) Sk 7 ^ a. 
This is used to find the next earliest occurring instance of the symbol a after the index i. 
Computing such a list for each symbol takes 0(n) time. So for a symbols, it takes 0{na) 
time. 

Each match is denoted by an ordered pair (z, j) where Si = Sj^ (1 < i < j < n) and 
{si € Sl) a (sj E Sr). Each contour is represented only by its dominant matches. All the 
dominant matches belonging to a contour are organised as a splay tree ([16], [10], [11]) with 
their respective second component (j) used as the key. The use of splay tree as the data 
structure has its advantages which is seen later in Sec. 4.2. The set of operations that can 
be performed on a splay tree aie discussed in the Appendix B. In addition to the key, the 
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first component ‘z’ of these matches is also stored in their respective nodes in the splay 
tree. The contours Ci,C 2 -^‘Cp are represented by their respective trees Ti,T 2 ...Tp. 

Lemma 4.1 Given any two dominant matches {ijj)^{i\f) G such that {j < f), we 
have (i > z') 

Proof: This lemma can be proved by contradiction. Consider the dominant matches 

(z, j) and We have the following two cases: 

1. If (z < z') then (z, j) 6 where > k. 

2. If (z = z') then (z,^*) is not a dominant match. 

50 (z > z'). In general this inequality (or ordering) holds for any number of dominant 
matches belonging to the same contour. | 

As a consequence of the above lemma, we can say that the inorder traversal of any tree 
Tk will list the the values of key j in increasing order and the values of z in decreasing 
order. 

The set of contours Ci, C' 2 ...Cp ^/2 for the two sequences Sl = siS 2 ...s „/2 ^md Sr = 
Sn/ 2 +i--^n is Constructed by making use of Extend Contours (Sec. 4.3). The sequence 

51 is extended one symbol at a time, from z = 1 through to z = n/2. In each iteration, 
the latest dominant match(it it exists) is always added to the leftmost position of its 
corresponding contour (this is by virtue of Lemma 4.1). So it would be feasible if we 
first construct the contours as linked list (Binary Search Tree growing in one direction). 
Later, when all the contours have been completely constructed, we build the corresponding 
balanced binary search trees. The time involved for these operations are later analysed in 
section 5.2. 

4.2 .Re-adjust Contours 

Re-adjust Contours reconstructs the contours after shifting the leftmost symbol from Sr 
to the rightmost position in S^. Let I be the current leftmost index of Sr. The column of 
matches corresponding to the shifted symbol (sj) are deleted from Ci to obtain C'l . This 
is accomplished by deleting the leftmost node in the tree Ti. This deleted node, (i, Z)> 
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represents the dominant match of the column L Let (^^ j'O be the next dominant match 
along the contour in the increasing order of the second component, that is [I < f). This 
can be found by searching Ti for by which the successor of j (which is f) is made the 
'root of the tree (property of splay tree operations). 


0 


b d a c d c a 


’La 

b 

c 


(a) 



b d a c d c a 

(l+l)a+2) n 



b d a c d c a 

(l+l)(l+2) n 



b d a c d c a 

(M)(l+Z) n 



Figure 4.1: Re-adjust Contours (after removing a from Sr) 


The contour C[ may not be a complete contour, as shown in Fig 4.1(b). So we check if 
C'l has to be updated to include a new dominant match. We first note that, if there is such 
a candidate match it has to be in that part of the contour Ci between the two dominant 
matches (z, 1) and Also, it cannot be along the column j' since {i'J') is already the 
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dominant match of this column. So the dominant match (if any) has to lie on the segment 
of the contour Ci inbetween I and f along the row i. The query j = Nextsi [l] returns the 
the index of earliest occurrence of the symbol Si after the index 1. This match (i, j), is 
nothing but the immediate next match after (i, 1) along the row i. This candidate match is 
inserted into the tree Ti as a dominant match if {j < f). If not, it is ignored. The match 
in checkered pattern in Fig. 4.1(c) denotes such a kind of match which is included in Ti 
as a dominant match. 

By definition, Ck includes all those matches for which the length of the longest common 
subsequence ending at each of these matches is k. So every match in C2 can be chained 
with at least one match in Ci to get a common subsequence of length two. The matches 
in Cl along I are lost when si is shifted from Sr to Sl,. So all those matches in C2 which 
could be chained only with the matches along /, no longer belong to C 2 . These matches 
are now included in C[ to get the complete contour Ci- 

Let (i,jf) be the leftmost dominant match of C[ (match in checkered pattern in Fig. 
4.1(c)). By Lemma 2.2, we have for every dominant match {i\f) G C 2 with (/ > j), 
some dominant match G such that (z'' < i') A (/^ < /). So all such matches 

with (/ > j) still belong to C' 2 . The complete contour Ci is obtained by joining that part 
of contour C 2 which extends from the left-end till j with C[ (the dashed polyline in Fig. 
4.1(d)). This is done by splaying the tree T 2 at j, by which the left subtree contains all the 
dominant matches which are to the left of j and the right subtree contains all the matches 
to the right of j. This left subtree is joined (by making use of join operation of splay trees) 
with Ti to obtain the complete contour Ci. 

The above set operations are repeated for the subsequent contours. 

4.3 Extend Contours 

After the contours are re-adjusted, they may have to be extended to include the row (or 
column) of matches. Let s; be the symbol that is shifted from Sr to Sl, n/2 < I < n. By 
this, a new row I is included at the bottom of the matrix M (shown by the dotted circle 
in Pig. 3.1(b)) The contours CuC 2 --Cp^ are processed from (1 < ^ < pi), one at a time. 
Let be the leftmost dominant match of the the current contour Ck- Let {l,j) be the 

current leftmost match along the row Z. We have three cases;- 
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1. If [f > j), then [l,j) is a dominant match in Ck, proceed to the next contour and 
also to the next match along the row Z, immediately after the column f . 

2. If {j' = j), then (Z, j) is just match in proceed to the next contour and also to 
the next match along the row Z. 

3. If (/ < jf), then (Z, j) is a part of some other contour, proceed to the next contour. 

The remaining matches(if any) along the row Z make up a new contour The 

leftmost among these matches will be the dominant match for this contour- We maintain 
a pointer to the leftmost node in each tree Ti,r 2 — '^vr The next immediate match along 
the row Z after the index j can be found using Nexts- [:/] in constant time. 

4.4 Shifting in the Reverse Direction 

The algorithm explained so far shifts the index Z rightwards one step at a time. A similar 
procedure can be used to shift the index leftwards (in the reverse direction). This procedure 
is of the same time complexity as that of the above algorithm. This procedure can be 
started off from the same set of initial trees Ti,r 2 ... ^Pn/2 corresponding to the contours 
Cl, C 2 ...Cp ^/2 Lemma 4.1). 

When the rightmost symbol in Sl is shifted to the leftmost position in the row 
of matches corresponding to this symbol (s^) is removed. This is done by deleting the 
leftmost dominant match, of the form (Z,j), in each contour, for (Z < j < n) (indicated 
by the dotted circle in Fig. 3.1 (b)). The shift may also add a column of matches towards 
the left side of the matrix M (indicated by the dotted circle in Fig. 3.1(a)). The contours 
Cl (through Cpi) have to be restructured so that these matches (and subsequent matches) 
are includea. Let (i, Z) be the topmost match along the column Z, we join this column with 
that part of contour Ci that extends from i till the rightmost end. This is done by splaying 
Ti at i and joining the right subtree of Ti and the dominant match of this colunrn (which 
is (i, Z)) as the left subtree. If we already have a dominant match (i, j) € Ti where (j > Z), 
we just update this node to (z,Z). In the subsequent modifications of contours (from C 2 
to CpJ, the left subtree can comprise of more than one dominant match. After all the 
contours are modified, we may obtain one additional contour Cp^^_^y where P(i-i) = pi + 1 
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4.5 Computing the current LCS 


The current longest common subsequence (a potential LTS) is computed whenever a new 
Pmax is obtained. The LCS is obtained in the reverse order starting from and ending 

at Cl. We take any dominant match in the inner most contour Let this match be 

By Lemma 2.2 we always have some dominant match (^^/) G C'(p^ax-i) 

((z' < i) A [f < j)). This match can be found by searching for j in the tree This 

search returns the predecessor of j in contour which is the match (^^ jO we are 

looking for. This search is repeated for the subsequent contours too, to obtain the chain 
of dominant matches in the reverse order. These dominant matches when rearranged in 
proper order gives us the current longest common subsequence. The time required for this 
process is analysed later in section 5.2. 



Chapter 5 


Correctness and Analysis 

5.1 Correctness of the Algorithm 

In order to prove the correctness of the algorithm, the invariant that has to be observed 
here is that, none of the contours touch or cross each other. The set of contours Ci, 
can be seen as a set of ordered lists. After each shift, the first element of Ci is deleted to 
obtain a partial contour C[. By definition, Ck includes all those matches which correspond 
to the match from the start of the longest common subsequence (till that match). 
So Cl represents the set of all first matches. Since, at each shift, the matches along the 
leftmost column are removed, Ci is updated so that it includes all the first matches. The 
algorithm is achieving this by splaying C 2 with respect to the first element of C[. Also, the 
algorithm does not stop just at this, it repeats the procedure for the subsequent contours. 

The invariant that no two contours touch or cross each other is also maintained. This 
is evident because the left subtree after the splay operation in iteration is joined with 
exactly one other tree, corresponding to the partial contour So the dominant matches 

corresponding to the left subtree belong to exactly one contour Ck- Since the contours are 
processed in order (1 < A: < p/), there will be no crossings. 

5.2 Analysis 

The preprocessing involves computing the list Aexta{0...n — 1] for each symbol a € E. This 
takes O(ncr-) time, where cr is the size of the alphabet S. If cr is 0(n), we make use of the 
data structure described in Chapter .6. Since we are storing onty the dominant matches 
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in the trees Ti,T2...Tp, we consider only the number of dominant nodes while analyzing 
the complexity involved in the tree operations. Rick [13] gives the following bound on the 
number of dominant matches each contour can have. For two sequences A = aia2..‘am 
and B = 6162. ..fen, < ^), if p is the length of the longest common subsequence, then we 
cannot have more than {{n — p) + (m — p) -f 1) dominant matches per contour. In case of 
LTS there is a single string S = siS2...Sn of length n. Let the length of the longest tandem 
subsequence be Pmax- So the bound on the number of dominant matches per contour in 
this case is (n ~ 2 p^ax + 1). 

Each splay tree operations take O(logn) amortized time. The time required for con- 
structing the trees for the initial set of contours Ci, C2...Cp^/2 sequences 

Sl = <SiS2...S„/2 and Sr = Sn/2+i^^.Sn is 

0{nPnl2 + Pnl2dnl2 log 4/2), 

where, 4/2 = (n — 2p^/2 + 1) is the maximum number of dominant matches each of these 
contours can have. 

At each iteration we add one symbol to Sr using Extend Contours. This may involve 
adding a dominant match to at most of p7i/2 lists. This process is done n/2 times. Since 
the contours are always growing in the leftward direction, the dominant match is always 
inserted at that beginning of the corresponding lists. This takes constant time. So totally, 
to construct the complete set of contours we require 0(n,py^/2) time. Once these lists 
are constructed we require 0(4/2 log 4/2) convert each of them to a balanced Binary 
Search Tree(BST). Since there are Pj^/2 such lists, totally we require 0(p„/24/2 log4/2) 
to construct all the balanced BSTs. 

Let p = pmax be the length of the longest tandem subsequence, (0 < p < n/2). Let 
d = (n — 2p + 1) represent the bound on the dominant matches. Each pass through Re- 
adjust Contours takes O(plogd) time, since we may re-adjust at most p contours and each 
of these re- adjustments take constant number of splay operations. The Re-adjust Contour 
operation is performed each time a symbol is shifted from S r to Sl or vice versa. We shift 
index I till p^^ position on the left and till (n - pf^ on the right. So, totally there are 
(n - 2p) = 0 {d) shifts. So total number of operations are at most 

{d x p x logd) 
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The time complexity of for each iteration of Extend Contour is 0{plogd). So the overall 
complexity of this step is O {dp log d)). 

The time take by the LCS{Si[si...si], Sr[si^i..,Sti]): which gives the longest tandem 
subsequence obtained so far, is 0(p log d). 

The time complexity of our algorithm to find the Longest Tandem Subsequence is 
0{na -f np ^/2 + Pnl 2 dn /2 log dn /2 + dp log d + p log d) 

= 0(ncr + dp log d). 

Space Complexity: The data structure Nexta[l^-.n]^ (Va E S) takes 0{na) space. We 
have p trees each of which contain at most d= (n — 2p + 1) nodes. So the space required 
for this is 0{dp). Hence, the space complexity of the algorithm is 

0{na + dp). 
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Chapter 6 


A New Data Structure for the LCS 
Problem 

6.1 Introduction 

Given two sequences A = aia 2 ...am and B = m < over some alphabet S 

of size cr, the Longest Common Subsequence (LCS) problem is to find a subsequence 
of greatest possible length that occurs in both A and B. In this chapter, we discuss a 
problem which is a special case of the LCS problem. Consider a scenario where we have 
a long Document sequence D = defined over a large alphabet E of size a. The 

document sequence D is queried {LCS search) at different instances by different short 
Query sequence, Q = gig2--?m- 


An important application is finding a consensus among DNA sequences [15]. The genes 
related to proteins synthesis evolve with time, but the functional regions remain consis- 
tent in order to work correctly. In order to find these functional regions, which remain 
unchanged through time, we make use of LCS algorithms. Another important related 
application is when biologists discover new genes, they wish to ascertain to which other 
known genes these newly discovered genes are similar. This is vital for identifying the 
function of a newly discovered gene. 

In this chapter, we design a space efficient data structure to represent the document 
sequence. The data structure also supports time efficient processing of the query. In 
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general the data structure described can be used to find the LCS between any given 
sequences A and as long as the given alphabet S is large i.e. the size a is of the order 
Ct{n/ log^n). 

6.2 Related Work 

The Longest Common Subsequence LCS has been extensively studied for over three 
decades. A number of algorithms were suggested over the years. The performance of 
each of these algorithms depended on different parameters like the length of the LCS (or 
the edit distance between the two input sequences), the size of the alphabet, the number of 
matches between the two sequences etc. The Table 6.1 gives a summary of space and time 
complexities of some of the well-known algorithms. In the table, m and n are the lengths 
of the two input sequences, A and jB, where m < n; p denotes the length of the LCS 
between A and B; d denotes the bound on the maximum number of dominant matches in 
each contour, [d < {n — p) + {m — p) + 1)^ this is from [14]. 


Work 

Time Complexity 

Space Complexity 

Preprocessing 

Overall 

Data 

Structure 

Runtime 

Hirschberg [5] 

0(n log cr) 

0{np + nlog n) 

0(n) 

* 

Nakatsu et al. [12] 

- 

0{m(n — t)) 

- 

0{mn) 

Hsu, Du [6] 

0(n log cr) 

0{pm log (n/m) + pm) 

C>(n) 

0{pd) 

Rick [13] 

0{na) 

0(na -f min{mp + p{n — p)}) 

0{na) 

0{na) 


Table 6.1: Previous work on LCS 


The first efficient algorithm wais suggested by Hirschberg [5]. Though the algorithm has 
a good time complexity of 0{np + nlogn), test results from Bergroth et al. [1] show that 
the runtime memory requirement for this algorithm is very high. As pointed out by Rick 
[14] the algorithm also has a high constant factor associated with it’s time complexity. 
The algorithm by Nakatsu et al. [12] involves little preprocessing, however, it has a space 
requirement of the order of 0(mn). Bergroth et al. [2] have tried to refine this algorithm 
through some heuristics. These heuristics try to estimate a lower bound and an upper 
bound on the length of the output. Though a little efficiency in terms of space is achieved, 
the time complexity nevertheless is more. The time complexity of Hsu, Du [6] is comparable 
to that of ours, but just like the algorithm in [5], the constant factors involved are high. 
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The performance of Rick’s [13] is very good, but it relies on a precomputed table of size 
Q{(jn) which requires 0{an) space. This overhead becomes high if the size of the alphabet, 
a is large. Our algorithm performs better when a > (n/log^n) and (m n)(see Section 
6.7 and Appendix C for a comparative analysis). 

6.3 Preliminaries 

We define two sequences, a Document sequence D = did 2 ‘--dn and a Query sequence^ 
Q = where n over an alphabet E of size a. The concepts of matches^ 

contours^ dominant matches are similar to those used in Chapter 2. 

Definition 6.1 A Predecessor of a dominant match (i^j) € is a dominant match 
(f', j') E Ck-i, such that (z' < z A / < j). 

Definition 6.2 The Closest Predecessor of a dominant match (z, j) E Cjt is a dominant 
match {i\f) E Ck-i, such that (z^ < i Af < j), and if there exists some dominant match 
E C/c-i, such that (z'' < i A/' < j), then {i” < i' A > j'). 

6.4 The Document Search Tree (DST) 

The only preprocessing that is done is construction of the Document Search Tree. The 
document sequence D = did 2 —dn is organized as a search tree. This tree is used for 
finding the immediately next occurring instance of a symbol ‘a’ in the sequence D, after 
a given index j. This is required for detecting the dominant matches (as discussed in 
Section 6.5.2). In this section we are going to describe the construction and operation of 
this Document Search Tree(DST). A search on the DST takes O(loglogn) time. 

6.4.1 Construction 
I Leaf Nodes 

The sequence D = did 2 ...dn is divided into logn segments of (n/logn) symbols each. Let 
these segments be called Xi^X^.-Xiogn- The segments Xi, X 2 ..-Xiogn stored as leaves 
of the DST. 

A. 
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aabb cdbc cccd dbdd 

1 2 3 4 5 6 7 8 9 10 ll 12 13 14 15 16 

Figure 6.1: DST for the sequence D = aabbcdbccccddbdd 


Each leaf Xi, (1 < ^ < logn) is organized as a set of (at most) a = |S| lists. These 
lists can be of two kinds (as shown in Fig. 6.2), based on the frequency /a (number of 
occurrence) of each alphabet a G E in X;. They are: 

Case 1: lf(0 < /a < logn), then store the indices(in increasing order) of occurrences 
of a as a simple array La- Let this list be called Type-I list. We can locate the nearest 
occurrence of any symbol a in 0(log/a) = O(loglogn) time (see Section 6.4.2 for 
details). 

Case 2: lf{fa > logn), then a list La[0...((n/logn) - 1)] is constructed in which at 
■ each index j of La we store the index of next occurring instance of a in Xi immediately 
after j. Let this be called Type-II list. A search of the nearest occurrence on this 
list takes 0(1) time (see Section 6.4,2 for details). 

In addition to these lists a bit vector V of size a (as shown in Fig. 6.1) is stored in each 
of these leaves. In a leaf Xi, the bit corresponding to a symbol a in the bit vector V is set 
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to 1 if La is not empty, otherwise it is set to 0. The organization of the DST is shown in 
Fig. 6.1 

1 2 3 4 5 6 7 8 9 10 11 12 
D=b cbacaadba cd 



Ty] 

pe-I 


La 

4 

6 

7 

10 



0 1 2 


Type-n 

11 

iU ll 

La 

4 

4 

4 

4 

6 6 7 10 10 10 ^ ^ 


Figure 6.2: Type-I and Type-II Lists for symbol a 


I Non-leaf nodes 

Each internal (nonleaf node) contains two bit vectors Vl and Vr. The bit vector Vr of 
an internal node is obtained through logical OR operation of the two bit vectors stored in 
its left child. Similarly, the bit vector Vr is obtained through logical OR operation of the 
two bit vectors stored in its right child. If the left child (or right child both) of an internal 
node is a leaf node the vector Vr of this internal node is assigned the same value as the 
vector V of its left child (or right child or the respective children). The Fig. 6.1 shows the 
bit vectors of all the nodes in the DST. 

6.4.2 Searching the DST 

Given an index j and a symbol a € S, the DST can be used to efficiently search the index 
of the next occurrence of a in D[did 2 • • * dn] immediately after j. We first locate into 
which of the segments j falls under. This segment I is obtained from [j/logn]. In the 
segment X;, the list La can be either of Type-I or Type-II as discussed in Section 6.4.1. 
Accordingly: 

Case 1 (Type I List): We check the list La to see if there is an occurrence of a 
after j. This takes constant time, since we only have to check the last entry in La- If 
this entry has a value greater than j, then surely La contains j (otherwise j might 
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be located in some subsequent segment I' > 1). The list La is searched for j to locate 
j . This would take at most O(loglogn) time, since the list is of size at most logn. 

Case 2 (Type II List): The index i(l < i < n) is first translated to j = j — 
(I * (n/logn)). If {La\)] 7 ^ </>), then the required index is = La\j]) (otherwise j" 
may be located in a subsequent segment V > 1). This index is translated back to 
(jf" = 'f + (Z * (n/ log n)). The overall time taken in this case is 0(1). 

The other case is, j” is located in some other segment. To locate this segment we start 
from the leaf Xi keep on moving up the DST till we encounter the first internal node, in 
which the bit vector has Vk[a] = 1 (the bit corresponding to the symbol a set to 1). 
Starting from this node we move downwards. Since we are searching for the next immediate 
occurrence of symbol a, we try keep towards left as much as possible, i.e. we check at each 
node (during the .downward traversal) if = 1, if so, we proceed towards left, otherwise 
we take the right child and continue to keep towards left as much as possible.Finally, when 
the leftmost leaf X// (after j containing an instance of symbol a) is reached, we return the 
first entry in the list La (irrespective of whether the list is of Type-I or Type-II) inside 
the leaf Xif, Since we ascend and descend the tree for at most log logn levels, the time 
involved here is 0 (log logn) 

6.5 The Algorithm 

The algorithm discussed in this section involves very little preprocessing. The same 
contour-based approach {as discussed in Chapter 2) is employed for finding the LCS be- 
tween D = did 2 **-dn and Q = The contours Ci, C 2 ...C'p are maintained as stacks 

51, 52... 5p. Here p denotes the length of the longest common subsequence between Q and 
D, The contents of the stack are compound nodes (not just a single element). \^^henever 
a dominant match (z, j) 6 Ci^ is discovered the following two things are pushed onto the 
stack Sk‘> 

• the match (z, j) 

• the index to the closest predecessor of (z, j) in Sk-i 

So the stacks contain only dominant matches and the index to their closest predecessors. 
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The LCS between Q and D can be easily traced once all the contours have been 
structed completely. We just need to choose a dominant match in the inner most coi 
Cp from it’s corresponding stack Sp and trace back to it’s closest predecessor in Sp^i, 
process is continued further till Si is reached. This would give us the LCS in the re 
order (see Lemma 2.2). 

6.5.1 Constructing the Contours 

The algorithm works as follows. The sequence Q = ^1^2 which are aligned as ro’ 
the matrix M is processed one symbol at a time . We maintain a list of indices ti, i 
corresponding to the top of the stacks 5i,52...5p respectively. This list is updated 
after each iteration i.e. after all the matches along the current row have been proce 
The dominant matches in the current row are pushed onto their respective stacks, < 
with the indices to their closest predecessors. The closest predecessor of a dominant n 
(ij) e Sk is nothing but the top most node t^-i of the stack Sk-v This can be si 
8LS follows. Let the be the match corresponding to We have (i' < i) be( 

points to the top of the stack 5fc_i(the most recent dominant match pushed) a 
the previous iteration {i — 1). So (i' < (i — 1)). We also have (/ < j). Since, if (/ 
then the match (i, j) G Ck-i, which is a contradiction. After the current row is proc 
completely^ we update to point to the current top of their respective stacks 

move on to the next row(symbol)- 

6.5.2 Detecting the Dominant Matches 

The process of detecting the dominant matches is similar to the one discussed in Se 
4.3. The only difference is that, here we incur an additional search cost to detect the 
dominant match along the current row. Let i be the current row being processed, 
contours Ci,C 2 ...Cp are processed from {I < k < p), one at a time. Let {i\f) b 
leftmost dominant match of the the current contour Ck- This is nothing but the top c 
stack 5/c. Let (ij) be the current leftmost match along the row i. We have three ca 

1. If {f > j), then (i, j) is a dominant match in Ck, proceed to the next contoui 
also to the next match along the row i, immediately after the colunrn f. 

2. If (/ = y), then (ij) is just match in Cfc, proceed to the next contour and also to 
the next match along the row i. 
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3. If (j < i)) then (z, j) is a part of some other (inner) contour, proceed to the next 
contour. 

A search is involved for the case 1, where we need to locate the next match along the 
row 2 , immediately after the column j\ Let qi represent the symbol corresponding to row i. 
We need to search for the index f of next occurrence of the symbol Qi (immediately after 
j') in D = did 2 ---dn> This is done by making use of the Document Search Tree described 
in Section 6.4. Once we have got this new leftmost match we again evaluate in 

which of the above three cases the current instance falls under, and the process is repeated 
for the subsequent contours. The remaining matches(if any) along the row i make up a 
new contour Cp+i- The leftmost among these matches will be the dominant match for this 
contour. 

6.6 Analysis 

6.6.1 Preprocessing 

There are logn segments ATi, A' 2 ...Xiogn each of size (n/logn) which are stored as leaves 
in DST. In each leaf X/, (1 < I < logn), we have a list La, (Va 6 S), either of Type~I 
or Type-IL The Type-I list has size of at most logn while each Type-II list has exactly 
n/logn entries. Each of this segments has a bit vector V of size a. We need 0{a) time to 
construct each such bit vector. So to construct logn vectors we need 0{a logn) time. 

Remark: Consider the case, when a > (n/log^n). The size of each leaf Xi is n/logn. 
If the symbols are distributed uniformly among the leaves, then in each leaf, each symbol 
has (((n/logn)/cr) < logn) average occurrences. Therefore each La, (Va G S) can be 
represented as Type~I list. In Type-I lists we store each index exactly once. So at each leaf 
the total complexity of constructing a lists is 0(n/logn). Since we have logn leaves, the 
construction of all the lists takes 0(logn x (n/logn)) = 0(n). This is the best case space 
and time requirement for all the leaves in the data structure DST. 

The other case is when in each leaf Xi, we store each La, (Va G E) as a Type-II list. This 
means that the number of occurrences of each symbol in every leaf is more than log n. So 
we store all the a lists as lists of size n/ log n exactly. In this case we require a total of 
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(a X n/logn x logn), which is of the order 0{na). This is the worst case space and time 
requirement for all the leaves in 'the data structure DST. 

In the DST we have logn leaves. So the depth of the tree would be O (log logn). The 
total number of nodes in the tree are of the order O(logn). The construction of tree 
therefore takes 0(<jlogn) time, where the a factor is for computing the bit vectors Vi and 
Vr at each node. The space required for storing all the bit vectors in the DST is of the 
order of O (a logn). 

To sum up everything, construction of the DST requires 0(n + ulogn) space and time 
in the best case. This is when a > (n/log^n). The complexity now becomes 0(n -H 
n/logn = 0(n). Hence the best case Time and Space Complexity for constructing the 
DST is 0(n). The worst case time and space complexity for constructing the DST is when 
a < (n/log^n). This is of the order 0(na). 

6.6.2 The Algorithm 

The construction of the contours takes 0(mp log logn) time. The entire query sequence 
Q = QiQ2-Qm is processed one symbol after the other. So we have m iterations. In each 
iteration we may add at most one dominant matches to each of the p contours. So all 
the p contours have to be checked. This checking may involve a search in the DST which 
requires O(loglogn) time. 

Rick [13] shows that the maximum number of dominant matches, d, any contour can 
have is d = (n — p) + (m — p) + 1. Since we are storing only the dominant matches the 
space requirement is 0{pd), The time required to report an instance of the LCS is 0(p). 
Since we store the index to the closest predecessor match for each dominant match. 

6.7 Comparison with the existing algorithms 

The advantage of our algorithm can be seen when the size of the alphabet is large i.e. 
c > (n/log^n). We assume that the alphabet is uniformly distributed through the input 
D = did^ ■ ■ ■ dn- The Table 6.2 gives a comparative analysis. 

It is evident from the table and also from the results shown in Appendix [?j that the 
algorithm in [13] suffers from the preprocessing overhead, when a > (n/log^n). The 
Algorithm 2 in [13] and the algorithm presented in this chapter ’.vere implemented and 
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Time Complexity 

Space Complexity 

Work 

Preprocessing 

Overall 

Data 

Structure 

Runtime 

Hirschberg [5] 

0(n log n) 

0{np + nlogn) 

0(n) 

* 

Nakatsu et al. [12] 

- 

0{Tn{n — r)) 

- 

0(mn) 

Hsu, Du [6] 

C)(n log n) 

0{pm log (n/m) + pm) 

0(n) 

0(pd) 

Rick [13] 

0(n^/log^ n) 

0({n?/log^ n) 
+min{mp -f p{n — p)}) 

0{n?/ log^ n) 

0{‘n?/log^n) 

Our Algorithm 

0(n) 

0(n -f mp log log n) 

0(n) 

0{pd) 


Table 6.2: Comparative Analysis of LCS algorithms(a > (n/log^n)) 


tested for different input size (m and n, (m n)) and different alphabet size {a). The 
input sequences were generated randomly. The algorithms were implemented in C-f + (Red 
Hat - 9.0, GNU C compiler (gcc version 3.2.2))on a Pentium 4(2.4 GHz), 256 MB RAM 
machine. The Appendix C gives a comparative study of the running times of both these 
algorithms. 
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Chapter 7 


Different Search Methods 

7.1 Introduction 

In the previous chapter, we saw how the DST is used to perforin a search in O(loglogn) 
time, to locate the next occurring instance of an alphabet a. In this chapter, we discuss 
some variations of the data structure, according to some specified Search Cost A, with the 
search time 0(A) between 0(1) and O(logn). We first describe how the search is performed 
in 0(1) and O(logn) time. We define the following terms before proceeding further: 
D[did 2 ---dn]- The input Sequence. 

E- The input alphabet. 

<j- The size of the input alphabet. 

w- The number of machine words required to store a bits. 

A- The search cost. 

k- The number of permissible levels of DST. 

fa- The total number of occurrence of the symbol a in the input sequence D. 
fa{Xi)- The frequency of occurrence of the symbol a in a the segment(or leaf) Xi. 

7.2 Different Search Methods 

In this section we discuss different searching methods. As in Section 6.4.1 we define the 
following kinds of lists. 

Definition 7.1 The Type-I list of an alphabet a is a simple array which stores the indices 
of occurrences of a in the increasing order (see Fig. 7.1) 
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In order to locate the next occurring instance of a after a given index j, a binary search is 
performed on the Type-I list. This takes O(logn) time. 

1 2 3 4 5 6 7 8 9 10 11 12 
D=bcbacaadba cd 



Definition 7.2 The Type-II list of an alphabet a is a simple array of size n where at each 
index i we store the index of immediate next occurring instance of a. (see Fig. 7.1) 

In order to locate the next occurring instance of a after the given index j, we just have 
to access the element in the Type-II list of the symbol a. This is a constant time 
operation. 

7.2.1 Search Cost A = 0(1) 

Construct Type-II lists (Va G S). This takes 0(na) space and time. 

7.2.2 Search Cost A = O(logn) 

Construct Type-I lists (Va € S). This takes 0(n) space and time. 

7.2.3 Search Cost kX^ Levels of DST = k 

The main idea is to construct the DSTs recursively. In the previous description of the 
DST^ as soon as we reached a depth of O(loglogn), we constructed the leaf nodes for each 
segment Xi. 

The idea here is that, we continue the process of constructing the DST upto a maximum 
of k levels. At the end of each level, we check in each segment if the fa{Xi)^ {\fa E E), is 
less than 2^^^, if so we construct Type-I lists for each of these alphabets. For the remaining 
symbols in Xi we construct DSTs recursively with the level reduced by one. 
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The input sequence I?[did 2 -..<in] is divided into 2*^ segments each of size n/2^. Let 
fa{Xi) be the frequency of occurrence of the symbol a in the segment Xi. We perform the 
following steps for each segment Xi (1 < I <2^). 

Step 1: (Va 6 E) where {fa{Xi) < 2^'^), Construct Type>I hsts for each such symbol 
a. 

Step 2: (V6 E S) where Uh{Xi) > 2^^). 

li{Level> l)then, construct DST with Search Cost— and Level=Level 

l{{Level= 0)then, construct Type-II lists for all such 6’s. 

Analysis: In the worst case the input sequence D[did 2 **-dn] of size n may be divided k 
times into (2^)^^ = 2^^ segments. In each of these 2^^ segments (Va e S), the frequency 
fa{Xi) may be greater than 2^”'^. So we have a Type-II list for each of these symbols. So in 
the worst case we can have a data structure comprising of k levels of DST and all the lists 
stored as Type-II lists. The Type-II lists for all the symbols take 0{na) space. If k levels 
of DSTs are constructed in depth first manner, i.e. constructing all the lists in the left 
most leaf before proceeding to the next leaf (rightwards), then we require 0{kn + na) time 
to construct all the leaves. The depth of one DST is 0(log2^) = 0(A). Since we have k 
such DSTs, the depth of the entire structure is 0{kX). In the complete data structure we 
have 0(2^'^) leaves. We store a bit vector for each of these leaves and in all other internal 
nodes too. So the total number of bit vectors is of the order 0(2^^^). So the total time 
required for obtaining all the bit vectors in the entire structure is 0(tf;(2^'^)). Hence, in 
the worst case the time complexity for constructing the Extended-DST is 

0{kn -h cm -h w2^^) 


and the space complexity is 

0(crn 4- w2^^) 

Example Consider the case, when n = 2^^, a = 3, A; = 2 and A = (log log log n). Since 
k = 2 in the worst case, the input sequence of size is divided twice into log log n segments. 
So the total number segments are (loglog)^n. Since we have n = 2^^, the total number 
of segments is 93. In each of these 93 segments we have around 2^^/93 5=^ 11 symbols per 
segment. 
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In each of the segments (of size 11) we can have faiXi) > 2^^ (Va € S). This is 
because, 11/3 > 2(loglogl0). Thus, in the worst case we have Type-II lists for all the 
symbols. | 

7.2.4 Search Cost = A, Unrestricted number of Levels 

In the previous section, we constructed DST upto k levels. At each level we filtered off 
those symbols which have a frequency of occurrence (in that segment) less than 2^^.The 
symbols remaining (in each segment) after constructing k levels of DST were represented 
as Type-II. 

Now, consider the case in which the number of levels are unrestricted, that is, we keep 
on constructing DSTs recursively till in each segment the frequency of occurrence for each 
symbol in that segment is less than the Search Cost At which point, we make use of 
Type-I list for storing the indices. 

Analysis: In the worst caise, we could have a tree in which all the leaves axe located 
at the same depth from the root (say a depth of kX). In each leaf (Xi) of this tree, we 
have (Va E T,),fa{Xi) = 2^^. So we have a Type-I lists each of size 2^. Thus the total 
number of symbols in each leaf is a x 2^. At each level we divide a segment from the 
previous level into 2^ segments. If n is the size of the input sequence and is of the form 
n = ((2^)^ X cr) for some fc, then we have k levels of DST in which each leaf contains <72^^ 
symbols. These symbols are represented as Type-I lists. The total space required for all 
the Type-I lists over all the leaves is 0(n), Since, there are k levels of DST^ we have 2^^ 
leaves and 0(2^’^) nodes. The space requirements for all the bit vectors is 0{w2^^). The 
total space complexity is 

0{n^w2^^) 

The time complexity to construct the Extended-DST with unrestricted number of levels 
is 

0{kn-\-w2^^) 

7.2.5 Selective Representation 

In this section we discuss another way of constructing the search data structure for each 
symbol a in E based on the frequency /a. We have a separate structure for each (a E S). 
Let the search cost be A. We make use of Type-I list to represent each symbol a if {fa < 2^^) 
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and Type-II lists for each symbol b with (/& > 2*-^). Let Fa be the total number of Type-I 
lists and F^, be the total number of Type-II lists. The size of the input sequence is n, we 
have: 

~ fa- + fb 

^ fb 

> {2^^)Fb 

Fh < n/{2^>') 

Since the total number of symbols in the alphabet is cr, we have 

Fh < min(cr,n/(2^'^)) 

If (/cA < log {n/a)) then < (n/2^^). 

The space complexity of this search structure is 0(min (na, n^/(2^''^))), as we require 
0(n) space for each Type-II list. The time required for this selective construction is also 
0(min (ncr, n^/(2^''^))) (the time required for constructing all the Type-II lists). 

7.3 Comparison of the Different Search Methods 

The following table (7.1) summarizes the space and time complexities of the different search 
methods. The size of the input sequence D[did 2 ---dr^ is indicated by ‘n\ V’ indicates the 
size of the alphabet, ‘/max’ represents the number of occurrences of the most frequently 
occurring alphabet in the input sequence D and ‘lu’ is the number of words required to 
represent a bits. 


Section 

Search Cost (A) 

(A = n(l) A A = O(logn)) 

Data Structure 

Space 

Time 

Sec. 7.2.1 

0(1) 

O(ncr) 

0(710-) 

Sec. 7.2.2 

/max) 

n 

n 

Sec. 7.2.4 

0(A) 

0(n -b w2'^^) 

0{kn + w2^^) 

Sec. 7.2.5 

0(A) 

0(min (nor,n^/(2^'^))) i 

0(min (n<j, n?/{2^^))) 


Table 7.1: Comparison of the Different Search Methods 
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Chapter 8 


Conclusions 


In this thesis we have described how the contour based approach can be used effectively 
for solving the ITS problem. We have designed an algorithm for the same which performs 
better than the previous O(n^) algorithm (based on dynamic programming) suggested by 
Kosowski [8]. We have also described a new data structure for solving the LCS problem. 
In addition to this, we have discussed different search data structures that could be used 
in the LCS problem. 

It has to be seen, if any of these search methods could be used to obtain a more efficient 
solution to the LTS problem. Another related problem in which these search techniques 
could be possibly used is that of finding the Longest Common Increasing Subsequence(L/5); 
Yang et. al [17] have proposed an algorithm with 0(mn) space and time complexities. 
Given two sequences A[aia 2 >‘Mm] in which symbols are comparable with 

each other, the LIS is a longest possible common subsequence in which the symbols are in 
strictly increasing order. 
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Appendix A 


The Algorithm(Pseudocode) 


Algorithm 1 : Preprocessing 
for a G S do 

construct (Nexta[0-.-{n — 1)]) 

end for 

for i = 1 to n/2 do 

Extend Contour s{S l [ si . . .Si_i] , i, iS'R[s(„/ 24 -i) . ..s„] ) 
end for 

Pmax — Pn/2 


Algorithm 2 : LTS{S[siS 2 ---Sn]) 
for j = 1 to Pmax do 

SHIFT_RIGHT{SL[si...Sj-i],SR[sj...Sn]) {shift one symbol from Sr to Sl} 
if (P(n/2+j) > Pmax) then 
Pmax P(n/2+j) 

T^LCS{Sl,Sr) 

end if 


SHIFT _LEFT{SL[si...Sj], 5h[sj+i...s„]) {shift one symbol from Sl to Sr} 

if {Pin/2-j) > Pmax) then 
Pmax P(n/2—j) 

T^LCSiSL,SR) 

end if 
end for 


return 




Algorithm 3 : SHIFT _RIGHT{SL[si...Sj-i], SR[sj...Sn]) 
{Re — adjust Contours} 
y <= find{{j + l),Ti) 

Tright ^ 

i 4= Tright — ^ TOW 
X 4= Nextsi [j] 

Ttemp ^ delete{j, Tright) {Delete column /} 


for k = 2 to pj do 

{insert new dominant match if it exists} 
if rr < y then 

'bright ^ iTlS&Tt{x^ '^temp) 

else 

Tright ^ •Spi<2y(y, 7}e77j,p) 

end if 

z 4= Tright ^ key 

Tleft ^ 

i 4= Tleft row 
X 4= Next Si [z] 

y ^ f'^rid{(Tieft ^ key) + l,T^e/t) 

Ttemp 4= Tleft right 
(Tleft right) NULL 
Tk—i ^ join(Tieft : Tright) 

end for 

(E'xtend Contottra} 
i 4= Nextsj [j] 
k <= 1 

while {(Tk NULL) A (i ^ NULL)) do 
if {i < Firstx}^) then 

{Firstx^ is the leftmost dominant match of the contour Ck} 
Tk <= insert{i^ Tk) 
i Nextsj[FirstTf,] 
k <= k 1 

else if (i — Firstx^) then 
i Nextsj [z] 
k 4= k 1 
else 

k /c 1 
end if 
end while 
if {i ^ NULL) then 

Tk+i <= create((i, j)){Create a new tree} 

Pj+i <= (k^l) 
end if 
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Algorithm 4 : >5'i7JFr_.L£’Fr(5£,[gi--Sj], 5fi[5j+i...5n]) 
for A: = 1 to fc = pj do 

if [j = Firstx^ — >■ row) then 
Tfc ^ deletelrow, Tk) 
end if 
end for 
X Nexts- [1] 

'^temp inscvtix, Ttemp) 

for A: = 1 to A: = pj do 
Tk ^ splay{x, Tk) 

Tie ft ^ Tk left 

{Tk -r left) <= NULL 
if x = Tk row then 
Tk key <(= j 
end if 

Tk join{Ttemp: Tk) 

X 4 = Tie ft -*■ row 
Ttemp ^ Tieft 

end for 

if Ttemp 7^ NULL then 
PO'-i) 

TpQ_^ Ttemp 

end if 


Algorithm 5 : LCS{Sl[siS 2 :.si], SR[si+i...Sn]) 

match <= Tpi — ^ key 
T\pi\ <^= SR[match] 
for k = {pi — 1) to 1 do 

{Find a predecessor match {i',j') € Ck for (i, j) € Ck+i such that {i' <i) A {j' < j)} 
match <= find{match, Tk) 

T[A:] = SR[match] 

end for 

return T[tlt 2 ■■■tp^] 


I 
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Appendix B 


Splay Trees 


Splay trees were developed by Sleator and Taxjan [16]. There are a kind of self organizing 
binary search tree, in which search operation can be performed in O(logn) amortized 
time. The following are some of the operations that can be performed on a splay tree, (as 
presented in Mehlhorn [10]): 

Access (x, T): If element x in the tree T, then return a pointer to its location, otherwise 
return NULL. 

Insert(xyT): Insert x into the tree T and return the pointer to the root. 

Delete (x,T): Delete x from tree T and return the resulting tree. 

Join(Ti,T2): Return a tree representing the elements of Ti followed by the elements 
of T2, destroying Ti and T2. (This assumes all the elements of Ti are smaller than all the 
elements of r2). 

Split(XyT): Returns two trees Ti and T2; Ti contains all the elements of T smaller 
than X and T2 contains all the elements of T larger than x (this assumes that x is in the 
tree); tree T is destroyed. 

The main operation of the splay tree is the Splay {x^ T) operation, using which all the 
above operations can be performed. 

Splay (xyT): Returns a tree representing the same set of elements as T. If x is in 
the tree then x becomes the root, otherwise, either the immediate predecessor of x or the 
immediate successor of x in T becomes the root. This operation destroys T. 





Appendix C 


Comparison Results 




Rick[13]’s Algorithm 

Our Algorithm 

n = \D\ 

m = IQI 

Preprocessing Time 

Overall Time 

Preprocessing Time 

Overall Time 

a = 40 

200 

25 

190 

196 

89 

158 

400 

50 

382 

413 

115 

379 

500 

80 

496 

543 

125 

626 

700 

125 

708 

795 

140 

1327 

II 

Cn 

O 

300 

75 

390 

412 

112 

396 

500 

100 

643 

686 

132 

702 

700 

150 

914 

1013 

156 

1382 

1000 

250 

1486 

1787 

168 



3535 

a = 65 

400 

100 

696 

770 

138 

541 

500 

125 

867 

923 

151 

775 

700 

175 

1225 

1367 

172 

1332 

1000 

300 

1838 

2155 

188 

2989 

II 

oo 

o 

500 

150 

1095 

1169 

159 

799 

700 

225 

1592 

1720 

182 

1504 

1500 

400 

3383 

4013 

244 

5231 

1750 

450 

3813 

4651 

261 

6483 ■ 

11 

b 

500 

150 

1270 

1345 

168 

694 

700 

250 

1931 

2111 

198 

1551 

1500 

300 

3728 

4197 

262 

3253 

2000 

400 

4970 

5800 

288 

5765 

3000 

500 

7298 

8793 

351 

10128 


Table C.l: Comparative Analysis of LCS algorithms((j > (n/log^n))(Time in /xs) 
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Figure C.3: a = 65 
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Figure C.4: <7 = 80 
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Figure C.5; cr = 94 



Figure C.6: cr = 94 axid n'^ m 
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